﻿ Andreea Macovei and Dan Cristea: Time Frames: Rethinking the Way to Look at Texts 59 Time Frames: Rethinking the Way to Look at Texts Andreea Macovei, Dan Cristea Faculty of Computer Science, “Al I Cuza” University of Iași General Berthelot 16 700483 Iași E-mail: {andreea gagea, dcristea}@info uaic ro Abstract In this paper, we discuss the challenging task of identifying time frames that may intersect in a text (a novel, a news article, a Facebook post, etc ), in a form more or less visible for the reader By time frame, we mean a sequence of events or statements that an author exposes voluntarily; these time frames can be considered specific writing techniques where diverse narrative threads are used for the purpose of capturing the reader's attention regarding the story as it develops A particularity of time frames is the fact that the transition from one time frame to another one seems to be rather difficult to discern and put in evidence by a forewarned annotator, while the consequences of the temporal discontinuities are understood naturally by a casual reader of the text We are going to explain this notion and to determine if it is necessary to propose a remodelled temporal annotation for this issue Keywords: time frames, temporal ruptures, event ordering often change the current direction of time, include 1 Introduction flashbacks, commute the story on a completely new axis, Attention towards detection of intrinsically connected or modify the perspective through which a story unfolds sequences of events in texts is relatively new in To deal with such linguistic phenomena, we introduce the computational linguistics Anchored in the need to notion of time frame, as a sequence of anchored or represent, extract and abstract narrative structures from unanchored events, belonging to a delimited period of streams of news, especially when gathered from different time, although the limits might be vaguely mentioned, if sources of information, a line of research seems to evolve at all The events of a time frame are not necessarily towards detection of timelines and storylines Timelines presented in a chronological order in the text and, as the are representations of chronologically ordered events in text unfolds, switches between different time frames time for a specific entity (Chambers, 2011) might also occur Most often, the reader is aware of Timeline extraction requires event detection and crossing a temporal border, even if, sometimes, with some classification, extraction of temporal relations, delay during reading Our aim is to determine if it is coreference resolution of entities and events, event possible to find out clues that may indicate the transition factuality, name entity recognition and temporal from one time frame to another one, in order to formulate expression recognition and normalization (Caselli et al , some directions for a process aiming to identify them 2015) Systems as VUA-Timeline (Minard et al , 2014) automatically are developed for extracting cross-document timelines Literary theoreticians consider that different time frames Storylines, on the other hand, are more complex are intentionally used by authors to introduce ambiguities representations, intended to take into account temporal, and to raise the suggestive power of their stories Often, causal and subjective dimensions A storyline comprises switches between time frames can be considered a the entire sequence of significant events exposed by the particularity of a text that would force the reader to zigzag narrator or by his/her characters But, despite the back and forth between different story levels The chronological order of events or the ordinary flow of the automatic identification of time frames can be an story, flashbacks, temporal ruptures, flash forwards, etc important step in disambiguating a text, reordering events, can appear and in this way, interrupt the storyline deciphering temporal relations and the general A storyline can be represented as the merger between organisation of the discourse individual timelines where two or more entities This paper describes a tentative approach to define and (characters) are involved in at least one relevant event recognise in free texts time borders which accommodate (Laparra et al , 2015) groups of related events called time frames Determining The necessity to determine storylines is strengthened by the time frames can be a premise in the automatic ordering the fact that starting with information specialists and of events in texts where no temporal indications appear or finishing with readers, all of them need to select large their appearance is scarce amounts of information in order to find stories, to monitor We intend thus to broaden the sphere of temporal events that involve one or more participants, to annotations and extend the data structures and attributes reconstruct cases, etc If the storylines are represented by of TIMEML, the standard mark-up language for schemas, these representations can reveal specific annotating events in a text The automatic identification information for better selections and innovative methods of time frames represents a further step in temporal used in processing texts information extraction and in natural language processing, In literary texts, such as novels and memories, the authors that could precede or go intertwined with the operation of Proceedings of the LREC 2016 Workshop “ISA-12: 12thJoint ACL - ISO Workshop on Interoperable Semantic Annotation", Harry Bunt (ed ) Andreea Macovei and Dan Cristea: Time Frames: Rethinking the Way to Look at Texts 60 determining the order of events Moreover, the final signal at each burst 3] outcome has a much ampler benefit than building a lattice This example shows another disposal of time frames: in of partially ordered events in time: it is intended to draw the first frame the author tells, sometimes in the past, a and relate the time frames one with respect to the others, story about a character, mentioned here as “someone”; in thus building a general overview of the text organisation the second frame, this “someone” remembers a movie; and the third frame develops the story in the movie 2 Time Frames in Texts A time frame encompasses one or more sequences of We focus on sequences of events which are not events, temporal scenes or episodes belonging to a necessarily paired with temporal information, as given by specific period of time with clear or vague limits that the the TIMEML standard As the dimensions of time can be reader discovers or establishes once he/she continues to expressed on 3 axis – the real time (of the reader), the follow the storyline discourse time (following strictly the text) and the time of The example below shows an intersection of two time the story (in which the time inversions that appear in the frames within a paragraph The adverb phrase (it was a text are reordered) – we state our interest as focussing the long time ago) clearly separates the first time frame from discourse time, as our intention is to decipher temporal the next one and semantic relations established among different time Example 3 (source: a novel3) frames, intentionally placed by the writer [1 Wait! Adam wanted to call him, to yell at Karl to return Time frames often denote flashbacks, producing temporal Do not go, this is what he wanted to scream But he ruptures which bring into attention things that happened remained silent and motionless, hidden in dense the before the current flow of the story A reader usually foliage full of thorns Now he was able to master and keep deciphers without difficulty these flashbacks, which silence, held his breath and counted slowly to ten 1] [2 she/he will connect later to the developing story, thus It was a long time since he had learned to control such a reconstructing the complete intended mis-en-scene fear 2] The following examples highlight the existence of multiple time frames in two short texts 3 Types of Time Frames and Lexical Example 1 (source: a Facebook post1): Features Announcing Transitions [1 Between the two rounds of preparing tomato sauce and In this section we suggest a categorisation of time frames a quick chat on Facebook, I remembered that 1] [2 I put The intention is to study the possible transitions between Teodor Baconschi's book “Facebook Factory narcissism” types and their signalling clues in the language Our among the books labelled "to necessarily read" 2], [3 investigation till now has put in evidence the following published this year by Humanitas 3] [2 I could not stop types: NAR – the narration frame (where the time flows myself from reading it until the end 2] constantly ahead); REM – the frame of remembers A closer look to this short text reveals three different time belonging to a character (also a narration frame, but frames emphasized by several sequences of events: the whose time limits are back in time with respect to a first frame includes the events indicated by the preceding narration type frame); SUP – the supposition preparation of the tomato sauce, the chat and the frame (where the time is vaguely attached to a plausible, remembrance; the second frame exposes the moment wanted or unwanted, world); GEN – the general when the book was placed on a shelve; and the third frame knowledge frame (where there is no time anchor, only is represented by the publication of Teodor Baconschi's statements about generally accepted things); FIC – a book The final sentence brings the reader back onto the fiction, an invented reality, like in a movie, a play or a second frame (because there is little chance that the novel (also a narration frame, but whose time limits have reading of the mentioned book would be made in no connection with respect to the current story time) sequence with the events on the first frame) The square Aiming to detect the borders between time frames brackets and their small attached figures make visible the belonging to these types, we started to investigate if there 3 frames are textual clues which signal the different types of Example 2 (source: a novel2): transitions [2 he had taken a bus full Table 1 shows the types of time frames and the cue of odours and noises to return to another city At some expressions announcing transitions for the three examples point, the noises reverberated, reminding him the leitmotif presented above of the movie 2] [3 that foreshadowed a warning for a possible nuclear war; on the east coast of Australia, the wind of a dead ocean struck the window on which was hung a bottle of Coca-Cola, which in turn struck a Morse 1 The post in Romanian can be found on: https://www facebook com/teodor baconschi/posts/9494920917 78957 23 The example is a fragment from Octavian Paler’s book “Life Example 3 represents a fragment of Tash Aw’s book, Map of on a Platform” the Invisible World Proceedings of the LREC 2016 Workshop “ISA-12: 12thJoint ACL - ISO Workshop on Interoperable Semantic Annotation", Harry Bunt (ed ) Andreea Macovei and Dan Cristea: Time Frames: Rethinking the Way to Look at Texts 61 Cue phrases perceived by readers, i e if more readers have the same Plan Type of plan Transitions announcing representation of time frames So far, our aim was to no transitions identify and collect examples of time frames, to clarify to remembered a number of students this notion and to train them to NAR  Example that recognize different pieces of text as belonging to the same time frame 1 REM  NAR In order to measure the agreement between annotators, NAR  told… that several groups of three students received a fragment of Tash Aw’s book, Map of the Invisible World4, and were eminding… r asked to determine if the received text exposed one or Example REM  that, more time frames and to annotate them according to the 2 possible, movie already-mentioned classes Also, they had to mark REM&SUP&FIC borders for each time frame and to indicate whether cue It was a long phrases announcing the transition between time frames Example NAR time exist The results show that in most cases, two out of three 3 NAR  students had a similar representation of time frames including identical borders and cues, while the third one had difficulty in detecting and delimiting time frames Table 1: Types of time frames and cue phrases The text was specially chosen for its richness of time announcing transitions frames and frequent switches between them As this is an incipient research, we considered the preliminary results As seen in the Example 2 of the table, it is possible for a obtained with our students encouraging, to the point to go frame to belong to more types (here REM, SUP and FIC, further towards annotating a larger corpus within the lines because the story of a film could develop on a fictive shown in this paper world which is remembered or narrated by a character) Our study is at an initial stage, but we can remark already 5 Relation with other Work that verbs such as remember, tell, say etc are good The field of extracting temporal information is candidates to announce a REM frame Also, other well-studied: from a delimitation of time-denoting possible cue features that signal transitions, noticed on the expressions (Schildder and Habel, 2001) as explicit references (precise dates: 06 02 2010), indexical investigated examples, could be: the change of verbs’ time, some nouns, adverbs and adverbial locutions references (temporal expressions which depend on a Figure 1 shows the relations existent among time frames, given index time: today, next Monday) and vague in the three examples Nodes of the graphs represent references (three days ago, in the summer, in several frames and edges represent interconnections as given by weeks) and the ontology of complex events (Mele and temporal relations Sorgente, 2011), there is a growing interest on ordering the events on a time axis and on determining the storyline In a story, the common chronological order of the events is not observed (Vossen et al , 2015) and each story may contain more than one fabula (by fabula, we mean logically and chronologically related events that are caused or experienced by participants in events) On the other hand, the notion of narrative container (Pustejovsky and Stubbs, 2011) is introduced in order to delimitate the events appeared in a text without any explicit temporal anchor The challenging work of these authors emphasizes the importance of the text style and genre in the attempt to fix in time not explicitly anchored events We believe that, more often than not, the events belonging to the same time frame are ordered temporally, even if different segments of the same time frame are not Figure 1: Graph representations showing contiguously displayed in the text An annotation of the interconnections of time frames events (EVENT tags) belonging to the same time frame (following the TimeML or ISO-TimeML specifications) is 4 Evaluation thus necessary Temporal links (TLINK tags) establish relationships between two or more events and order the We have conducted an evaluation of our work on a very small scale, for the time being Our interest was to find out if the concept of various time frames in a text can really be 4 We thank to the Humanitas Publishing House for offering us the Romanian version of the book for research purposes Proceedings of the LREC 2016 Workshop “ISA-12: 12thJoint ACL - ISO Workshop on Interoperable Semantic Annotation", Harry Bunt (ed ) Andreea Macovei and Dan Cristea: Time Frames: Rethinking the Way to Look at Texts 62 events in time The temporal expressions as dates, evaluating narratives ACL-IJCNLP 2015, 50 durations, times, etc (TIMEX3 tags) will bring anchoring Mele, F , & Sorgente, A (2011) A Formalism for information that will help to position different time Temporal Annotation and Reasoning of Complex frames or segments of time frames in time Events in Natural Language DART@ AI* IA, 771 Minard, A L , Speranza, M , Agirre, E , Aldabe, I , van 6 Conclusion Erp, M , Magnini, B , & Kessler, F B (2015, June) In this paper we propose a new way of looking at a text Semeval-2015 task 4: Timeline: Cross-document event that combines elements of time analysis and text structure ordering In Proceedings of the 9th International The approach resides on the identification of segments of Workshop on Semantic Evaluation (SemEval 2015) (pp texts, called time frames, that are individualised by 778-786) coherent placements of sequences of events, observations Pustejovsky, J , & Stubbs, A (2011, June) Increasing about certain phenomena, places, general knowledge, etc , informativeness in temporal annotation which are temporally situated on different time intervals In Proceedings of the 5th Linguistic Annotation or characterising opinions of different characters In the Workshop(pp 152-160) Association for unfolding of a text, time frames could be interrupted and Computational Linguistics interleaved, but their relationship can be represented as a Schilder, F , & Habel, C (2001, July) From temporal graph that structures the text with respect to places, expressions to temporal information: Semantic tagging moments or intervals of time, characters and situations, of news messages In Proceedings of the workshop on being them real, supposed or fictive Temporal and spatial information processing-Volume Identification of time frames is important in deciphering 13 (p 9) Association for Computational Linguistics the structure of the discourse Apart from being relatively well delimited in time, time frames could be related or not among them with respect to the time axis There is much work to be done in the future We intend to do several things: continue this analysis by completing the classification of types, inventorying possible signals for frame transitions, proposing annotation conventions in view of a corpus analysis and performing comparative annotation in order to see to what degree different annotators have similar opinions about time frames The technique of frame story or story within a story could be a premise in detecting the style of each author, the creativity of her/his writing and the level of involvement in order to attract the interest of a reader This has much to do with our time frames Working on literary texts, our challenge is to investigate complex text structures, rich in flashbacks and constructions about fictive worlds, frequent ruptures of time, and other types of time frames that could raise new ideas and formalisations, with the final goal to develop a process that would do an automatic identification This research highlights a preparatory analysis that can end up in the development of a tool capable to identify and graphically represent time frames in a text This will be a tremendous step forward towards the goal of mirroring in the machine the human capacity of deep understanding of a text 7 Bibliographical References Caselli T , A Fokkens, R Morante, P Vossen: “What happened to …?” Entity-based Timeline Extraction, in proceedings of 25th Meeting of Computational Linguistics in the Netherlands (CLIN2015), February 5-6, 2015, University of Antwerp, Belgium Chambers, N , & Jurafsky, D (2008, June) Unsupervised Learning of Narrative Event Chains In ACL (Vol 94305, pp 789-797) Laparra, E , Aldabe, I , & Rigau, G (2015) From TimeLines to StoryLines: A preliminary proposal for Proceedings of the LREC 2016 Workshop “ISA-12: 12thJoint ACL - ISO Workshop on Interoperable Semantic Annotation", Harry Bunt (ed )